Method and apparatus for processing virtual world

ABSTRACT

In an apparatus and method for processing a virtual world, haptic information regarding a virtual object in the virtual world, the haptic information corresponding to sensed information, is extracted and transmitted to a haptic feedback device. Accordingly, interaction between a real world and the virtual world is achieved. The processing speed of the haptic information with respect to the virtual object may be increased by varying data structures according to types of the virtual object.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of Korean Patent Application No.10-2010-0034399, filed on Apr. 14, 2010, in the Korean IntellectualProperty Office, the disclosure of which is incorporated herein byreference.

BACKGROUND

1. Field

Example embodiments of the following description relate to a method andapparatus for processing a virtual world, and more particularly, to amethod and apparatus processing haptic information regarding a virtualobject in a virtual world.

2. Description of the Related Art

Currently, interest in experience-type games has been increasing.Microsoft Corporation introduced PROJECT NATAL at the “E3 2009” PressConference. PROJECT NATAL may provide a user body motion capturingfunction, a face recognition function, and a voice recognition functionby combining Microsoft's XBOX 360 game console with a separate sensordevice including a depth/color camera and a microphone array, therebyenabling a user to interact with a virtual world without a dedicatedcontroller. Also, Sony Corporation introduced WAND which is anexperience-type game motion controller. The WAND enables interactionwith a virtual world through input of a motion trajectory of acontroller by applying, to the Sony PLAYSTATION 3 game console, alocation/direction sensing technology obtained by combining a colorcamera, a marker, and an ultrasonic sensor.

The interaction between a real world and a virtual world operates in oneof two directions. In one direction, data information obtained by asensor in the real world may be reflected to the virtual world. In theother direction, data information obtained from the virtual world may bereflected to the real world using an actuator.

Accordingly, there is a desire to implement an improved apparatus andmethod for processing haptic information regarding a virtual object.

SUMMARY

The foregoing and/or other aspects are achieved by providing anapparatus for processing a virtual world, including a receiver toreceive sensed information from a sensor, an extractor to extract hapticproperty information from virtual object information regarding a virtualobject corresponding to the sensed information, and a transmitter totransmit the haptic property information to a haptic feedback device.

The foregoing and/or other aspects are achieved by providing a methodfor processing a virtual world, including receiving sensed informationfrom a sensor, extracting haptic property information from a virtualobject information regarding a virtual object corresponding to thesensed information, and transmitting the haptic property information toa haptic feedback device.

Additional aspects, features, and/or advantages of example embodimentswill be set forth in part in the description which follows and, in part,will be apparent from the description, or may be learned by practice ofthe disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects and advantages will become apparent and morereadily appreciated from the following description of the exampleembodiments, taken in conjunction with the accompanying drawings ofwhich:

FIG. 1 illustrates a virtual world processing system that controlsinformation exchange between a real world and a virtual world, accordingto example embodiments;

FIG. 2 illustrates a virtual world processing apparatus according toexample embodiments;

FIGS. 3 through 5 illustrate a data structure of an avatar according toexample embodiments;

FIGS. 6 and 7 illustrate a data structure of a virtual object except foran avatar, according to example embodiments; and

FIG. 8 illustrates a flowchart describing a virtual world processingmethod, according to example embodiments.

DETAILED DESCRIPTION

Reference will now be made in detail to example embodiments, examples ofwhich are illustrated in the accompanying drawings, wherein likereference numerals refer to the like elements throughout. Exampleembodiments are described below to explain the present disclosure byreferring to the figures.

FIG. 1 illustrates a virtual world processing system that controlsinformation exchange between a real world and a virtual world, accordingto example embodiments.

Referring to FIG. 1, the virtual world processing system may include areal world 110, a virtual world processing apparatus, and a virtualworld 140.

The real world 110 may denote a sensor adapted to detect information inthe real world 110, or a sensory device adapted to realize theinformation of the virtual world 140 in the real world 110.

The virtual world 140 may denote a virtual world realized by a program,or an immersive media reproducing apparatus adapted to reproducecontents including sensory effect information practicable in the realworld 110.

The sensor according to the example embodiments may detect informationon an action, state, intention, shape, and the like of a user of thereal world 110, and transmit such information to the virtual worldprocessing apparatus.

Depending on embodiments, the sensor may transmit data such as sensorcapability 101, sensor adaptation preference 102, and sensed information103.

The sensor capability 101 denotes information on the capability of thesensor. The sensor adaptation preference 102 denotes a degree of userpreference with respect to the sensor capability. The sensed information103 denotes information on the real world 110 detected by the sensor.

The virtual world processing apparatus according to the exampleembodiments may include an adaptation real world to virtual world (RV)120, virtual world information (VWI) 104, and an adaptation Real Worldto Virtual World/Virtual World to Real World (RV/VR) 130.

The adaptation RV 120 may convert, into information applicable to thevirtual world 140, the sensed information 103 detected by the sensorwith respect to the real world 110 based on the sensor capability 101and the sensor adaptation preference 102. Depending on embodiments, theadaptation RV 120 may be embodied by an RV engine.

The adaptation RV 120 according to example embodiments may convert theVWI 104 using the converted sensed information 130.

The VWI 104 may be information of the virtual object of the virtualworld 140.

The adaptation RV/VR 130 may encode the converted VWI 104 and therebygenerate virtual world effect metadata (VWEM) 107 which refers tometadata related to effects applied to the virtual world 104. Dependingon embodiments, the adaptation RV/VR 130 may generate the VWEM 107 basedon virtual world capabilities (VWC) 105 and virtual world preferences(VWP) 106.

The VWC 105 may be information related to capabilities of the virtualworld 140. The VWP 106 may be information denoting a degree of userpreference with respect to the capabilities of the virtual world 140.

The adaptation RV/VR 130 may transmit the VWEM 107 to the virtual world140. Here, the VWEM 107 may be applied to the virtual world 140 so thateffects corresponding to the sensed information 103 may be realized inthe virtual world 140.

An effect event occurring in the virtual world 140 may be driven by thesensory device, that is, an actuator of the real world 110.

The virtual world 140 may generate sensory effect metadata (SEM) 111 byencoding sensory effect information which is information on the effectevent generated in the virtual world 140. Depending on embodiments, thevirtual world 140 may include an immersive media reproducing apparatusthat reproduces contents including the sensory effect information.

The adaptation RV/VR 130 may generate sensory information 112 based onthe SEM 111. The sensory information 112 may be information on theeffect event being realized by the sensory device of the real world 110.

The adaptation VR 150 may generate information on a sensory devicecommand (SDCmd) 115 to control operation of the sensory device. Theadaptation VR 150 may generate information on the SDCmd 115 based oninformation on sensory device capabilities (SDCap) 113 and informationon user sensory preference (USP) 114.

The SDCap 113 may be information on capabilities of the sensory device.The USP may be information denoting a degree of user preference withrespect to effects being realized by the sensory device.

FIG. 2 illustrates a virtual world processing apparatus 200 according toexample embodiments.

Referring to FIG. 2, the virtual world processing apparatus 200 includesa receiver 210, an extractor 220, and a transmitter 230.

The receiver 210 may receive sensed information from a sensor.

The sensor is adapted to detect information regarding an object in areal world. The sensor may include a tactile display. The tactiledisplay refers to a display capable of detecting a touch input appliedto a screen.

Depending on embodiments, the sensor may encode the sensed informationinto extensible markup language (XML) type metadata, for example, andtransmit the XML type metadata to the virtual world processing apparatus200. In addition, the sensor may encode the sensed information intofirst metadata in the form of XML type metadata, and may further encodethe first metadata into second metadata in the form of binary metadatato transmit the second metadata to the virtual world processingapparatus 200.

When a user touches a head of an avatar showing on the tactile display,the sensed information may include information on a position on thescreen, to which the touch input is applied, and information on atouched portion of the avatar of the virtual world, that is, the head ofthe avatar.

The extractor 220 extracts haptic property information from virtualobject information which is information regarding the virtual object.

The virtual object may include an avatar having a figure of a person oran animal, and other types of virtual object.

The virtual object information which refers to information on thevirtual object may include the haptic property information.

The haptic property information refers to information on a hapticproperty given to the virtual object. For example, the haptic propertyinformation may include information on a material of the virtual object,roughness of the material, and the like. Also, the haptic propertyinformation may include the sensory effect information. The sensoryeffect information may be the information on the effect event realizedby the actuator. For example, if the haptic property information isrelated to the roughness of the material, the sensory effect informationmay be information on intensity of a vibration, which corresponds to theroughness.

The avatar and other virtual objects may have different data structures.

The virtual object information regarding the virtual object except theavatar may include the haptic property information. In other words, asingle virtual object may include single haptic property information.Therefore, when the virtual object is any virtual object other than theavatar, the extractor 220 may extract the haptic property informationfrom the virtual object information regarding a virtual objectcorresponding to the sensed information, for example, a virtual objecttouched by the user through the tactile display.

When one virtual object includes a plurality of components, each of theplurality of components may include one haptic property. Here, theextractor 220 may extract the haptic property information regarding eachcomponent from the virtual object information.

For example, if a telephone in the virtual world includes a phonereceiver and a main body as components, when the user touches the phonereceiver by touching the tactile display, the extractor 220 may extracta haptic property of the phone receiver from the virtual objectinformation regarding the telephone.

The virtual object information regarding the avatar may include anappearance element, for example, and a haptic property list.

The appearance element may include information on appearance of theavatar. The appearance element may also include the haptic reference ID.

The haptic property list refers to a list containing the haptic propertyinformation applied to the avatar. Depending on embodiments, the hapticreference ID may be allocated to the respective haptic propertyinformation.

When the virtual object is the avatar, the extractor 220 may extract thehaptic reference ID from the appearance element of the avatar, theappearance element corresponding to the sensed information, and mayextract the haptic property information corresponding to the hapticreference ID from the haptic property list.

In other words, the haptic reference ID, as opposed to the hapticproperty information, may be allocated to each appearance element of theavatar. Therefore, the extractor 220 may refer to the haptic propertylist using the haptic reference ID to extract the haptic informationregarding the appearance element. That is, the extractor 220 may extractthe haptic property information corresponding to the haptic referenceID, from the haptic property list.

The transmitter 230 may transmit the haptic property informationextracted by the extractor 220 to the haptic feedback device.

The haptic feedback device is adapted to drive effects corresponding tothe haptic property information in the real world. The haptic feedbackdevice may include a Braille type display, a 4D theater vibration seat,a massage chair, and the like.

The transmitter 230 may encode the haptic property information into theXML-type metadata and transmit the metadata to the haptic feedbackdevice. In addition, the transmitter 230 may encode the haptic propertyinformation into the binary metadata and transmit the binary metadata tothe haptic feedback device. Also, the transmitter 230 may encode thehaptic property information into the first metadata in the form of theXML type metadata, and further encode the first metadata into the secondmetadata in the form of the binary metadata to transmit the secondmetadata to the haptic feedback device.

Hereinafter, a data structure of a virtual object will be described indetail with reference to FIG. 3 through FIG. 7.

FIGS. 3 through 5 illustrate diagrams showing the data structure of anavatar as the virtual object, according to example embodiments.

AvatarType 310 in FIG. 3 denotes the data structure of the avatar in avirtual world.

The AvatarType 310 may include VWOBasetType 320, for example, and aplurality of elements.

The VWOBasetType 320 denotes information on a base type of the avatar ofthe virtual world. The VWOBasetType 320 may include identification 321,VWOC 322, and a behavior model list 323.

The plurality of elements of the AvatarType 310 may include Appearance331, Animation 332, CommunicationSkills 333, Personality 334,ControlFeatures 335, and HapticPropertyList 336.

The Appearance 331 may include information on the appearance of theavatar. According to example embodiments, the Appearance 331 may includea haptic reference ID without haptic property information. A virtualworld processing apparatus according to example embodiments may extractthe haptic property information from a haptic property list using thehaptic reference ID.

The HapticPropertyList 336 denotes a list including the haptic propertyinformation applied to the avatar.

Referring to FIG. 4, AvatarAppearanceType 410 includes Body 411, Head412, Eyes 413, Ears 414, Nose 415, MouthLip 416, Skin 417, Facial 418,Nail 419, BodyLook 420, Hair 421, Eyebrows 422, Facial Hair 423,AppearanceResources 424, FacialCalibrationPoints 425, PhysicalCondition426, Clothes 427, Shoes 428, and Accessories 429.

The avatar appearance type 410 denotes the data structure of theappearance element of the avatar.

Depending on embodiments, the appearance element regarding the Body 411,the Head 412, the Eyes 413, the Ears 414, the Nose 415, the MouthLip416, the Skin 417, the Facial 418, the Nail 419, the BodyLook 420, theHair 421, the Eyebrows 422, and the FacialHair 423 may include thehaptic reference ID.

Table 1 shows XML code syntax regarding the avatar appearance typeaccording to example embodiments.

TABLE 1 <!-- ################################################ --> <!--Avatar Appearance Type --> <!--################################################ --> <complexTypename=“AvatarAppearanceType”> <sequence> <element name=“Body”type=“vwoc:BodyType” minOccurs=“0”/> <element name=“Head”type=“vwoc:HeadType” minOccurs=“0”/> <element name=“Eyes”type=“vwoc:EyesType” minOccurs=“0”/> <element name=“Ears”type=“vwoc:EarsType” minOccurs=“0”/> <element name=“Nose”type=“vwoc:NoseType” minOccurs=“0”/> <element name=“MouthLip”type=“vwoc:MouthType” minOccurs=“0”/> <element name=“Skin”type=“vwoc:SkinType” minOccurs=“0”/> <element name=“Facial”type=“vwoc:FacialType” minOccurs=“0”/> <element name=“Nail”type=“vwoc:NailType” minOccurs=“0”/> <element name=“BodyLook”type=“vwoc:BodyLookType” minOccurs=“0”/> <element name=“Hair”type=“vwoc:HairType” minOccurs=“0”/> <element name=“EyeBrows”type=“vwoc:EyebrowsType” minOccurs=“0”/> <element name=“FacialHair”type=“vwoc:FacialHairType” minOccurs=“0”/> <elementname=“AppearanceResources” type=“anyURI” minOccurs=“0”maxOccurs=“unbounded”/> <element name=“FacialCalibrationPoints”type=“vwoc:FacialCalibrationPointsType” minOccurs=“0”/> <elementname=“PhysicalCondition” type=“vwoc:PhysicalConditionType”minOccurs=“0”/> <element name=“Clothes” type=“vwoc:VirtualObjectType”minOccurs=“0” maxOccurs=“unbounded”/> <element name=“Shoes”type=“vwoc:VirtualObjectType” minOccurs=“0” maxOccurs=“unbounded”/><element name=“Accessories” type=“vwoc:VirtualObjectType”minOccurs=“0”maxOccurs=“unbounded”/> </sequence> </complexType>

Table 2 shows XML code syntax with respect to the avatar appearance typeregarding the Body 411 of the avatar, according to example embodiments.

TABLE 2 <complexType name=“BodyType”> <sequence> <elementname=“BodyHeight” type=“float” minOccurs=“0”/> <elementname=“BodyThickness” type=“float” minOccurs=“0”/> <elementname=“BodyFat” type=“vwoc:measureUnitLMHType” minOccurs=“0”/> <elementname=“TorsoMuscles” type=“vwoc:measureUnitLMHType” minOccurs=“0”/><element name=“NeckThikness” type=“float” minOccurs=“0”/> <elementname=“NeckLength” type=“float” minOccurs=“0”/> <element name=“Shoulders”type=“float” minOccurs=“0”/> <element name=“Pectorials” type=“float”minOccurs=“0”/> <element name=“ArmLength” type=“float” minOccurs=“0”/><element name=“HeadSize” type=“float” minOccurs=“0”/> <elementname=“TorsoLength” type=“float” minOccurs=“0”/> <elementname=“LoveHandles” type=“float” minOccurs=“0”/> <elementname=“BellySize” type=“float” minOccurs=“0”/> <element name=“LegMuscles”type=“float” minOccurs=“0”/> <element name=“LegLength” type=“float”minOccurs=“0”/> <element name=“HipWidth” type=“float” minOccurs=“0”/><element name=“HipLenght” type=“float” minOccurs=“0”/> <elementname=“ButtSize” type=“float” minOccurs=“0”/> <element name=“Package”type=“vwoc:indicateOfSMBType” minOccurs=“0”/> <element name=“SaddleBags”type=“vwoc:indicateOfSMBType” minOccurs=“0”/> <!--elementname=“KneeAngle” type=“mpegvct:InclineAngleType” minOccurs=“0”/--><element name=“KneeAngle” type=“vwoc:angleType” minOccurs=“0”/> <elementname=“FootSize” type=“float” minOccurs=“0”/> </sequence> <attributename=“hapticIDRef” type=“IDREF” use=“optional”/> </complexType>

Table 3 shows XML code syntax with respect to the avatar appearance typeregarding the Head 412 of the avatar, according to example embodiments.

TABLE 3 <!-- ################################################ --> <!--Head Type --> <!-- ################################################ --><complexType name=“HeadType”> <sequence> <element name=“HeadSize”type=“vwoc:measureUnitSMBType” minOccurs=“0”/> <elementname=“HeadStretch” type=“vwoc:unlimitedPercentageType” minOccurs=“0”/><element name=“HeadShape” minOccurs=“0”> <simpleType> <restrictionbase=“string”> <enumeration value=“square”/> <enumerationvalue=“round”/> <enumeration value=“oval”/> <enumeration value=“long”/></restriction> </simpleType> </element> <element name=“EggHead”type=“boolean” minOccurs=“0”/> <element name=“HeadLength” type=“float”minOccurs=“0”/> <element name=“FaceShear” type=“float” minOccurs=“0”/><element name=“ForeheadSize” type=“float” minOccurs=“0”/> <elementname=“ForeheadAngle” type=“vwoc:angleType” minOccurs=“0”/> <elementname=“BrowSize” type=“float” minOccurs=“0”/> <element name=“FaceSkin”minOccurs=“0”> <simpleType> <restriction base=“string”> <enumerationvalue=“dry”/> <enumeration value=“normal”/> <enumerationvalue=“greassy”/> </restriction> </simpleType> </element> <elementname=“Cheeks” type=“vwoc:measureUnitSMBType” minOccurs=“0”/> <elementname=“CheeksDepth” type=“float” minOccurs=“0”/> <elementname=“CheeksShape” minOccurs=“0”> <simpleType> <restrictionbase=“string”> <enumeration value=“chubby”/> <enumeration value=“high”/><enumeration value=“bone”/> </restriction> </simpleType> </element><element name=“UpperCheeks” type=“vwoc:measureUnitSMBType”minOccurs=“0”/> <element name=“LowerCheeks”type=“vwoc:measureUnitSMBType” minOccurs=“0”/> <elementname=“CheekBones” type=“vwoc:indicateOfDMUType” minOccurs=“0”/></sequence> <attribute name=“hapticIDRef” type=“IDREF” use=“optional”/></complexType>

Referring to Table 2 and Table 3, the XML code syntax with respect tothe avatar appearance type regarding the Body 411 and the Head 412includes ‘<attribute name=“hapticIDRef” type=“IDREF” use=“optional”/>.’That is, the appearance element includes the haptic reference ID asopposed to the haptic property information. Accordingly, the virtualworld processing apparatus may be able to extract the haptic propertyinformation with respect to the appearance element of the avatar, usingthe haptic reference ID.

Referring to FIG. 5, EarsType 510 among appearance elements of theavatar may include attributes 520 and a plurality of elements.

The attributes 520 denotes information on attributes of the appearanceelement regarding the EarsType 510.

The attributes 520 may include hapticIDRef 521. The hapticIDRef 521 maybe ID information regarding the haptic property information included inthe haptic property list.

For example, when a user touches ears of the avatar showing on a tactiledisplay, a tactile display sensor may transmit sensed information to thevirtual world processing apparatus.

Here, the sensed information may include position information regardinga touched position on a screen of the tactile display, and informationthat the virtual object corresponding to the position information isears of the avatar.

The virtual world processing apparatus may extract the hapticIDRef 521included in the appearance element regarding the ears, from the virtualobject information regarding the avatar.

In addition, the virtual world processing apparatus may extract thehaptic property information corresponding to the hapticIDRef 521, fromthe haptic property list included in the virtual object informationregarding the avatar.

In addition, the virtual world processing apparatus may transmit theextracted haptic property information to the haptic feedback device.

The EarsType 510 may include EarSize 531, EarPosition 532, EarAngle 533,AttachedEarlobes 534, and EarTips 535.

Table 4 shows XML code syntax with respect to the avatar appearance typeregarding the ears, according to example embodiments.

TABLE 4 <!-- ################################################ --> <!--Ears Type --> <!-- ################################################ --><complexType name=“EarsType”> <sequence> <element name=“EarSize”type=“float” minOccurs=“0”/> <element name=“EarPosition”type=“vwoc:indicateOfDMUType” minOccurs=“0”/> <element name=“EarAngle”minOccurs=“0”> <simpleType> <restriction base=“vwoc:angleType”><maxInclusive value=“180”/> </restriction> </simpleType> </element><element name=“AttachedEarlobes” type=“float” minOccurs=“0”/> <elementname=“EarTips” type=“vwoc:indicateOfPMNType” minOccurs=“0”/> </sequence><attribute name=“hapticIDRef” type=“IDREF” use=“optional”/></complexType>

FIGS. 6 and 7 illustrate a data structure of a virtual object except foran avatar, according to example embodiments.

Referring to FIG. 6, VirtualObjectType 610 denotes a data structure of avirtual object except for an avatar.

The VirtualObjectType 610 may include a VWOBaseType 620 and a pluralityof elements.

The VWOBaseType 620 denotes information on a base type of the virtualobject in a virtual world. The VWOBaseType 620 may includeidentification 621, VWOC 622, and BehaviorModelList 623.

The plurality of elements of the VirtualObjectType 610 may includeAppearance 631, Animation 632, and HapticProperty 633.

Different from the AvatarType 310 of FIG. 3, the VirtualObjectType 610includes information on HapticProperty 633 of the virtual object,without a haptic property list. Therefore, the virtual world processingapparatus may extract haptic property information directly from virtualobject information.

For example, when the user touches a virtual car showing on a tactiledisplay, a tactile display sensor may transmit sensed information to thevirtual world processing device.

Here, the sensed information may include position information regardinga touched position on a screen of the tactile display, and informationthat the virtual object corresponding to the position information is avirtual car.

The virtual world processing apparatus may extract information on theHapticProperty 633 from the virtual object information regarding thevirtual car.

In addition, the virtual world processing apparatus may transmit theextracted information on the HapticProperty 633 to the haptic feedbackdevice.

Table 5 shows XML code syntax with respect to the virtual object type,according to example embodiments.

TABLE 5 <!-- ################################################ --> <!--Virtual Object Type --> <!--################################################ --> <complexTypename=“VirtualObjectType”> <complexContent> <extensionbase=“vwoc:VWOBaseType”> <sequence> <element name=“Appearance”type=“anyURI” minOccurs=“0” maxOccurs=“unbounded”/> <elementname=“Animation” type=“vwoc:VOAnimationType” minOccurs=“0”/> <elementname=“HapticProperty” type=“vwoc:VWOHapticPropertyType” minOccurs=“0”/><element name=“VirtualObjectComponents”type=“vwoc:VirtualObjectListType” minOccurs=“0”/> </sequence></extension> </complexContent> </complexType> <complexTypename=“VirtualObjectListType”> <sequence> <element name=“VirtualObject”type=“vwoc:VirtualObjectType” maxOccurs=“unbounded”/> </sequence></complexType>

According to example embodiments, the virtual object may include aplurality of components.

Referring to FIG. 7, VirtualObjectType 710 denotes a data structure ofthe virtual object in the case where the virtual object except for anavatar includes the plurality of components.

The VirtualObjectType 710 may include VirtualObjectComponents 720. Whenthe virtual object includes the plurality of components, theVirtualObjectComponents 720 denote object information regarding eachcomponent of the virtual object.

The VirtualObjectComponents 720 may include VirtualObjectListType 730.

The VirtualObjectListType 730 may have the same data structure as theVirtualObjectType 610 of FIG. 6. Therefore, the VirtualObjectListType730 may include only one haptic property. That is, each of the pluralityof components of the virtual object may include only one hapticproperty.

For example, if the virtual car includes wheels and a car body ascomponents, when the user touches the wheels shown on the tactiledisplay, the tactile display sensor may transmit sensed information tothe virtual world processing apparatus.

Here, the sensed information may include position information regardinga touched position on a screen of the tactile display, and informationthat the virtual object corresponding to the position information is thewheels of the virtual car.

The virtual world processing apparatus may extract haptic propertyinformation regarding the wheels of the virtual car from the virtualobject information.

In addition, the virtual world processing apparatus may transmit theextracted haptic property information to the haptic feedback device.

FIG. 8 illustrates a flowchart describing a virtual world processingmethod, according to example embodiments.

Referring to FIG. 8, the virtual world processing method receives sensedinformation from a sensor in operation S810.

The sensor is adapted to detect information on an object in a realworld. The sensor may include a tactile display. The tactile displaydenotes a display capable of detecting a touch input applied to ascreen.

Depending on embodiments, the sensor may encode the sensed informationinto an XML type metadata and transmit the XML type metadata. Inaddition, the sensor may encode the sensed information into firstmetadata in the form of XML type metadata, and may further encode thefirst metadata into second metadata in the form of binary metadata totransmit the second metadata.

When a user touches a head of an avatar showing on the tactile display,the sensed information may include information on a position on thescreen, to which the touch input is applied, and information on atouched portion of the avatar of the virtual world, that is, the head ofthe avatar.

In operation S820, The virtual world processing method extracts hapticproperty information from virtual object information regarding thevirtual object, which corresponds to the sensed information.

The virtual object may be classified into an avatar having a figure of aperson or an animal, and other types of virtual object.

The virtual object information which refers to information on thevirtual object may include the haptic property information.

The haptic property information refers to information on a hapticproperty given to the virtual object. For example, the haptic propertyinformation may include information on a material of the virtual object,roughness of the material, and the like. Also, the haptic propertyinformation may include sensory effect information. The sensory effectinformation may be information on the effect event realized by anactuator. For example, if the haptic property information is related tothe roughness of the material, the sensory effect information may beinformation on intensity of vibration, which corresponds to theroughness.

The avatar and other virtual objects may have different data structures.

The virtual object information regarding the virtual object except theavatar may include the haptic property information. In other words, asingle virtual object may include single haptic property information.Therefore, when the virtual object is any virtual object other than theavatar, the virtual world processing method may extract the hapticproperty information from the virtual object information regarding avirtual object corresponding to the sensed information, for example, avirtual object touched by the user through the tactile display.

When one virtual object includes a plurality of components, each of theplurality of components may include one haptic property. Here, thevirtual world processing method may extract the haptic propertyinformation regarding each component, from the virtual objectinformation.

For example, if a telephone of the virtual world includes a phonereceiver and a main body as components, when the user touches the phonereceiver by touching the tactile display, the virtual world processingmethod may extract a haptic property of the phone receiver from thevirtual object information regarding the telephone.

The virtual object information regarding the avatar may include anappearance element and a haptic property list.

The appearance element may include information on appearance of theavatar. The appearance element may also include the haptic reference ID.

The haptic property list refers to a list containing the haptic propertyinformation applied to the avatar. Depending on embodiments, the hapticreference ID may be allocated to the respective haptic propertyinformation.

When the virtual object is the avatar, the virtual world processingmethod may extract the haptic reference ID from the appearance elementof the avatar, the appearance element corresponding to the sensedinformation, and may extract the haptic property informationcorresponding to the haptic reference ID from the haptic property list.

In other words, the haptic reference ID, as opposed to the hapticproperty information, may be allocated to each appearance element of theavatar. Therefore, virtual world processing method may refer to thehaptic property list using the haptic reference ID to extract the hapticinformation regarding the appearance element. That is, the virtual worldprocessing method may extract the haptic property informationcorresponding to the haptic reference ID, from the haptic property list.

The virtual world processing method transmits the extracted hapticproperty information to the haptic feedback device in operation 830.

The haptic feedback device is adapted to drive effects corresponding tothe haptic property information in the real world. The haptic feedbackdevice may include a Braille type display, a 4D theater vibration seat,a massage chair, and the like.

According to example embodiments, the virtual world processing methodmay encode the haptic property information into the XML-type metadataand transmit the metadata to the haptic feedback device. In addition,the virtual world processing method may encode the haptic propertyinformation into the binary metadata and transmit the binary metadata tothe haptic feedback device. Also, the virtual world processing methodmay encode the haptic property information into the first metadata inthe form of the XML type metadata, and further encode the first metadatainto the second metadata in the form of the binary metadata to transmitthe second metadata to the haptic feedback device.

The apparatus and method according to the above-described exampleembodiments may be recorded in non-transitory computer-readable mediaincluding program instructions to implement various operations embodiedby a computer. The media may also include, alone or in combination withthe program instructions, data files, data structures, and the like. Theprogram instructions recorded on the media may be those speciallydesigned and constructed for the purposes of the example embodiments, orthey may be of the kind well-known and available to those having skillin the computer software arts. Examples of non-transitorycomputer-readable media include magnetic media such as hard disks,floppy disks, and magnetic tape; optical media such as CD ROM disks andDVDs; magneto-optical media such as optical disks; and hardware devicesthat are specially configured to store and perform program instructions,such as read-only memory (ROM), random access memory (RAM), flashmemory, and the like. The media may be transfer media such as opticallines, metal lines, or waveguides including a carrier wave fortransmitting a signal designating the program command and the dataconstruction. Examples of program instructions include both machinecode, such as produced by a compiler, and files containing higher levelcode that may be executed by the computer using an interpreter. Thedescribed hardware devices may be configured to act as one or moresoftware modules in order to perform the operations of theabove-described example embodiments, or vice versa.

Although example embodiments have been shown and described, it would beappreciated by those skilled in the art that changes may be made inthese example embodiments without departing from the principles andspirit of the disclosure, the scope of which is defined in the claimsand their equivalents.

1. An apparatus for processing a virtual world, comprising: a receiverto receive sensed information from a sensor; an extractor to extracthaptic property information from virtual object information regarding avirtual object corresponding to the sensed information; and atransmitter to transmit the haptic property information to a hapticfeedback device.
 2. The apparatus of claim 1, wherein, if the virtualobject is an avatar, the extractor extracts a haptic referenceidentification (ID) from an appearance element of the avatar, theappearance element corresponding to the sensed information, and extractsthe haptic property information corresponding to the haptic reference IDfrom a haptic property list.
 3. The apparatus of claim 2, wherein thevirtual object information regarding the avatar comprises the appearanceelement and the haptic property list.
 4. The apparatus of claim 1,wherein, if the virtual object comprises a plurality of virtual objectcomponents, the extractor extracts the haptic property information fromthe virtual object information regarding a first virtual objectcomponent corresponding to the sensed information
 5. A method forprocessing a virtual world, comprising: receiving sensed informationfrom a sensor; extracting haptic property information from a virtualobject information regarding a virtual object corresponding to thesensed information; and transmitting the haptic property information toa haptic feedback device.
 6. The method of claim 5, further comprisingextracting a haptic reference identification (ID) from an appearanceelement of an avatar when the virtual object is the avatar, wherein theextracting of the haptic property information extracts the hapticproperty information corresponding to the haptic reference ID from ahaptic property list.
 7. The method of claim 6, wherein the virtualobject information regarding the avatar comprises the appearance elementand the haptic property list.
 8. The method of claim 5, wherein, if thevirtual object comprises a plurality of virtual object components, theextracting of the haptic property information extracts the hapticproperty information from the virtual object information regarding afirst virtual object component among the plurality of virtual objectcomponents which corresponds to the sensed information.
 9. Anon-transitory computer readable recording medium storing a program tocause a computer to implement the method of claim
 5. 10. An apparatus tointeract between the real world and a virtual world, comprising: areceiver to receive information sensed by a sensor in the real world; anextractor to extract haptic property information from virtual objectinformation of a virtual object in the virtual world and correspondingto the sensed information; and a transmitter to transmit the hapticproperty information to a haptic feedback device in the real world. 11.The apparatus of claim 10, wherein the virtual object comprises anavatar including an appearance element corresponding to the sensedinformation.
 12. The apparatus of claim 11, wherein the sensedinformation comprises position information regarding a touched positionon the sensor and information on a touched portion of the avatar. 13.The apparatus of claim 11, wherein the extractor extracts a hapticreference identification (ID) from the appearance element, and extractsthe haptic property information corresponding to the haptic reference IDfrom a haptic property list.
 14. The apparatus of claim 13, wherein theavatar comprises the appearance element and the haptic property list.15. A method of interacting between the real world and a virtual world,comprising: receiving information sensed by a sensor in the real world;extracting haptic property information from virtual object informationof a virtual object in the virtual world and corresponding to the sensedinformation; and transmitting the haptic property information to ahaptic feedback device in the real world.
 16. The method of claim 15,wherein the virtual object comprises an avatar including an appearanceelement corresponding to the sensed information.
 17. The method of claim16, wherein the sensed information comprises position informationregarding a touched position on the sensor and information on a touchedportion of the avatar.
 18. The method of claim 16, wherein theextracting haptic property information comprising extracting a hapticreference identification (ID) from the appearance element, andextracting the haptic property information corresponding to the hapticreference ID from a haptic property list.
 19. The method of claim 18,wherein the avatar comprises the appearance element and the hapticproperty list.
 20. A non-transitory computer readable recording mediumstoring a program to cause a computer to implement the method of claim15.